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■ Abstract 

<D 

We study a linear quadratic problem for a system governed by the heat equation on 
a halfline with Dirichlet boundary control and Dirichlet boundary noise. We show that 
this problem can be reformulated as a stochastic evolution equation in a certain weighted 
P^J . L 2 space. An appropriate choice of weight allows us to prove a stronger regularity for the 
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boundary terms appearing in the infinite dimensional state equation. The direct solution 
of the Riccati equation related to the associated non-stochastic problem is used to find the 
solution of the problem in feedback form and to write the value function of the problem. 
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m ; 1 Introduction 

In this paper we are concerned with a linear quadratic control problem for a heat equation on 
the halfline [0, oo) with Dirichlet boundary control and boundary noise. More precisely, for 
fixed < r < T, we deal with the equation 



9 y(t,0 = -Ly(t,0 te[r,T], £ > o, 



y(t,0) = u(t) + W(t) te[r,T], (1) 

. y(r,0 = M0 £>o. 

where W is a one dimensional Brownian motion and u is a square-integrable control. Let us 
recall that a deterministic boundary control problem 

' §- t z(t,0 = ^z(t,0 te[r,T], £>o, 

z(t,0) = u(t) te[r,T], (2) 

z(t,0 = x {0 £>0, 
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is well understood, see for example [3], [33]). Denoting by Aq the Dirichlet Laplacian in 
L 2 (0, oo) and by D the Dirichlet map (defined as D\ in JTU|) below), we can rewrite j2|) in 
the form 

z {t) = e tAo x + (A - Ac) [ e { - t - s)Aa Du{s)ds , 



o 



and it is easy to show that z(t) G L 2 (0, oo) for all t > 0. Therefore, the process 

X{t) = e tA "x + (A - A Q ) f e^- s)A °Du{s)ds + (A - A Q ) f e^~ s)A ° DdW{s) (3) 

Jo Jo 

seems to be a good candidate for a solution to (JTJ) . However, it was shown in [7] that the 
process X is not L 2 -valued. More precisely, it was shown that the solution to ([I]) considered 
on a finite interval and for u = 0, when rewritten in the form j3]), is well defined in a negative 
Sobolev space H~ a for a > \ only. It is easy to see that the same conclusion holds in the 
case of halfline. Then it was shown in [2j, see also [I], that the process X can be defined 
pointwise on (0, oo) and it takes values in a weighted space L 2 (0, oo; £} +e d^) . This fact was 
used to study some properties of the process X (in fact in the aforementioned papers more 
general nonlinear equations are studied) but the problem is not reformulated as a stochastic 
evolution equation in L 2 (0, oo; £, 1+0 d£) and therefore advantages of using the weighted space 
are somewhat limited. 

Following the idea of Krylov [12] we introduce the weighted spaces TL P = 1? ((0, oo); p(£)d£), 
where for 9 £ (0, 1) we have 

p(0=e +9 or p(£) = min £ > 0. 



It was proved in [TT] and [12] that the Dirichlet Laplacian Ao defined on L 2 (0,oo) extends to 
a generator A of an analytic semigroup (e tA ) on 7i p . We will show that the Dirichlet map 
takes values in dom((— A) a ) for a certain a > ^ and therefore equation j3]), when considered 
in TC P , can be given a form 



X{t) = e tA x + f e (t ~ s)A (A - A) Du{s)ds + f e ( '~ s)A (A - A ) DdW{s) 
Jo Jo 



that is, we will study a controlled evolution equation 



dx(t) = (Ax(t) + Bu(t)) dt + B dW(t) 
x(t) = x G Hp 



(4) 



for B = (Ao — A)D. This fact is a starting point for our analysis of the linear quadratic control 
problem (pD). We will demonstrate that the control problem (Jl|) when considered in the space 
Hp can be solved using classical by now techniques presented, for example, in [3]. Let us 
emphasize that while focus of this paper is on the most interesting case of boundary control 
and boundary noise a more general control problem 

dx{t) = (Ax(t)+B Ul (t)+v(t)) dt + BdW{t) +dW 1 (t) 
x(t) = x GHp (5j 

with spatially distributed noise W\ and control v might be easily considered using the same 
technique. 
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Let us note that if the boundary conditions are of Neumann type then the analogue of equation 
(CO) has a solution in L 2 (0, oo) and has been studied intensely (also for more general parabolic 
equations with boundary noise), see for example [7J, [32], [8], [9]. 

We study the linear quadratic problem characterized by the cost functional 

rT 



J(r, xq, u) = E 



\Cx(t)\ z Y + \u(t)\idt + (Gx(T),x(T)) 



(6) 



and governed by a state equation of the form Q. the operator C that appears in J6]) is 
in £(TL P ;Y) for a certain Hilbert space Y and G G £(7i p ;7i p ) is symmetric and positive. 
The direct solution of the Riccati equation related to a linear quadratic problem driven by 
a stochastic equation different from ours was studied in the Neumann case (non-weighted 
setting) in [10] (see also [1] and [5] for the control inside the domain case (a = 1)). Our 
approach is different from the one used in the aforementioned works since we directly use the 
solution of the Riccati equation for the "associated" deterministic problem. 
The deterministic linear quadratic problem associated to ours is that characterized by the 
state equation 

x(t) = Ax(t) + Bu(t) 

and the functional 



J [\Cx\ 2 Y + \u\l) dt + (Gx(T),x(T)} 



Ho 



(7) 



It is well known, see [3j and Section 3 below, that the solution to the linear quadratic problem 
given above is determined by the operator-valued function P : [0, T] — > £ (Tt p , 7i p ) which 
solves the so-called Riccati equation 

P'(t) = -A*P(t) - P(t)A* - C*C + P{t)ABB*A*P(t) 
P(T) = G. ^ > 

Such a problem has been intensely studied (see [3 J and [14] and the references therein). We will 
refer in particular to the direct solution approach and we will use the formalism introduced 
in Section 2.2. of [3]. We show that the Riccati equation JH) has a unique solution P in the 
space C SjQ ([0, T]; S(W)) (see Definition 13. 2|) . Let us note that in the deterministic case the 
minimum of the cost functional j7| is given by (P(t)xq, xq)^. 

In the study of the problem with boundary noise some of the tools and the results of the 
deterministic CclSC, clS the properties of the elements of C SjQ ([0, T]; £ {H p )) and the solution 
of (|8j), are still useful. It is possible to express the value function and the optimal feedback 
in terms of P. A term due to the noise appears in the expression of the minimal cost and we 
have that (Theorem [3771): 



V(t,x ) = inf J(t,x ,u) 

U&Jt 



(P(r)xo,x )+ I -(((\ -A)D(l)),P(s)((\ -A)D(l))) H ds. (9) 



2 The heat equation in TL P 
2.1 Notation 

We will work in a weighted space TL p = L 2 ([0, cxd); p(£,)d£), where either p(£) = A 1 or 
p(£.) = £, 1+e f° r some 6 € (0, 1) and £ > 0. All the results proved in the sequel are valid for 
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both weights and therefore, in order to simplify notations we will use the same notation 
TL = Tip for both weights. Let us recall that / G TL if and only if 

/>oo 

Jo 

and TL is a Hilbert space with the scalar product 

/>oo 

(cj>, i>) n = / d£ for all (pjtfj £ 7i. 

Jo 

Given A > 0, the Dirichlet map D\ is defined as follows: 

D ^ = «~{m = i m = ° fM ^ >0 (10) 



so -Da (a) = aip\ where 



Clearly t/j\ £ 7Y. 

It is well known that for every xq € L 2 (0, oo) the solution y to the heat equation with zero 
Dirichlet boundary condition 

' &y(i,£) = Jfry(t,0 t >0, £>0, 
y(t,0)=0 ^ t>0, 

, 1/(0,0 = »o(o e>o. 

is given by the following well known expression 

/>oo 

y(t,0 = / e,»7)a?o(»7)di7 (12) 
Jo 

where 

k(t,£,ri) = -=[e — -e — ) , 77, C > 0. (13) 



/47Tt 

This formula defines the corresponding heat semigroup T(t)xQ = y(t) in L 2 (0,oo). It is also 
well known that (T(t)) is a symmetric Co-semigroup of contractions on L 2 (0,oo). 

2.2 Properties of the heat semigroup on TL 

Proposition 2.1. For each of the weights p(£) considered above, the heat semigroup (T(t)) 
extends to a bounded Cq semigroup (e ) t > Q on TL with generator A: dom(j4) — ► TL. The 
semigroup { etA ) t>0 is analytic. 

Proof. The case p(£) = £} +d : H = L 2 ([0, 00), £ 1+e ci£) . 

Let / S L 2 (0,oo). Then by Theorem 2.5 in [12] there exists C > independent of / and such 
that 

\e tA f\ n < C\f\ n , t>0. 
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Since L 2 (0, oo) is dense in H, e tA can be extended to 7i and the strong continuity follows by 
standard arguments. Let Aq be the generator of (T(t)) in L 2 {0, oo) and let V = dom (Ao)r\TC C 
H. Clearly 



e tA V CP, t > 



and T> is dense in 7i. Therefore T> is a core for the generator A of (e tA ) in 7i. If / € T> then 



and again by Theorem 2.5 in [12J we have 



d 2 

w T(t)l 



<?!/!«■ 



Since P is a core for the generator A'mTi, the above estimate can be extended to any f EH 
and therefore 



\Ae tA f\ H <j\f\ H feH. 

The last inequality is equivalent to the analyticity of the semigroup (e ia ) in TL. follows. 
The case p(£) = lA£ 1+e : H = L 2 ([0, oo), 1 A £ 1+e d£) . 

Let x £ Cq°(0, oo) and t <T. Then the functions xi = a?I[o,i] and x 2 are in L 2 (0, oo) and TL P 
for both weights p. It follows that 

\(T(t)x\ n < \T(t)(x m x)\ n + \T(t)(x il)+oo) x)\ H 

< |r(t)(X[0,i]a?)lz, a 1+fl + I t O)(X(i,+oo)2:)Il2(o,+oc) (14) 



H 



for a certain C > 0. The fact that C does not depend on t < T is a consequence of the Co 
property of T t on L 2 1+e (showed in the first part of the proof) and on L 2 (0, oo). Therefore 

(T(t)) has an extension to a semigroup (e tA ) on H and the Co-property follows by standard 
arguments. Similar arguments yield analyticity of (e'" 4 ) . □ 



Lemma 2.2. Assume that A > and r > 0. Then 

ip\ G dom((r — A) a ) for all a £ 

In particular D x G £(M; dom((A - 4) Q )) /or a// a G [0, \ + 



1 
°'2 + 4 



Proof. We consider the case of p (g) = only. The other case may be proved by similar if 
somewhat simpler arguments. 

Note first that if Va G (dom(A),H) 2 ,a then V>A G dom((r-,4) a ) for all a G (0, 1 — cr)0, 
see for example Theorem 11.5.1 in |16j . Hence the claim will follow if we show that G 
{dam(A),n) 2 ,a for 

15 1 

2-I < " < 5- (15) 



1 (dom( A), TC)2,tr denotes the real interpolation space 
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By Theorem 10.1 of [E]) i>\ G (dom(4), H) 2 a if and only if 

r^- 3 \{e tA -l) 1>x\ldt< 
Jo 

and taking into account (fT5l) it is enough to show that 



oc 



I 



t^- d \(e tA -I)^ n <oo. 



(16) 



(17) 



To show (fTT]) we will use (jT2j) and JT3]) and the definition of Denoting by N the cumulative 
distribution function of the standard normal distribution, we obtain 



i= /V- 3 r e +e \(e tA -i)^m\ 2 didt 

Jo Jo 

= /V- 3 r e +e ( / 

Jo Jo \ Jo 



e ^ 



e- Xr >dr) 



e 4t 



-e~ Xr >dr) - e A « d£dt 



<2{h+I 2 + I 3 ) 
where I\, I 2 and I3 are respectively 



I1 



2cr-3 



+00 



1+9 



2i 



Since for i £ [0, 1] we have 



e x ^e xH I 1 - N 



< ( e A2 — 1 ) t we find that Ii converges for every a > 0. 



d£dt 



d£di 



d£di 



I3 can be estimated, using that the standard estimate 

1 e" s2 / 2 

(l_ N(s) )< 



as follows: 



J a < / t 



i2cr-3 







s V2vr 



+00 nj 

^l+e e 2A5 e 2A 2 tf£ e -^ 2 /(2t) 



d£dt 



<d t 
Jo 

= Ci / / 
Jo 

<Ci( / t 



2<t-2 



+00 



-1+0 p 2A5-? 2 /(2t) 



d^dt 



i2cr-2 



-l+e t ^ e 2XyVt~y 2 /2 t l/2 d ^ dt 



*2cr-2- 



2 di 



+OO 



where the finiteness of the first term follows from (ITojl . The estimate for I2 can be obtained 
in a similar way. □ 
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2.3 Properties of the solution of the state equation 

Let W be a real Brownian motion on a probability space (Q,^ 7 , P) and let {Ttj denote the 
natural nitration of W . We need to give a rigorous meaning to equation ([[]). To this end we 
will assume in the sequel that 

A > and a G I -, - + - 

are fixed. We will denote by D the operator D\ £ £(R;D((Ao — A) a )) and V% = D\ (l). 
By Proposition 12.11 the semigroup (e tA ) is analytic and therefore for any 7 > 

|| (A - A)~<e tA \\ H < M^-" 1 for all t € (0,T], (18) 

see for example [18] (Theorem 6.13 page 75). By Lemma |2~2"1 the operator B = (Ao — A)D : 
R — > is bounded^. Moreover, for t > the operator 

Ae tA D Xo = (Ao - A) l ~ a e tA (A - A) a D Xo :R^H 

is bounded as well. We will write e B = Ae D\ Q Now, we reformulate equation equation 
([1]), still formally, as a stochastic evolution equation in Ji: 

dx{t) = (Ax(t) + Bu(t)) dt + BdW(t) 

x(t) =x eH { } 

where the control u is chosen in the set M^(r, T;R) of progressively measurable processes 
endowed with the norm 

f T 

\\u\\ 2 M 2^ =Ey \u{t)\ 2 dt < 00. 
The next two results show that we can give a meaning to (fT9l) . 



Theorem 2.3. For all 7 < 2a — 1 the following holds. 

(i) The operator t — > e tA B : R — > H is bounded for each t > and the function 



is continuous for every a E 
(ii) 



t -► e tA Ba 



T 

s-t II (A - A) e sA ^Ao ||l ds < 00. (20) 







7 Ao 11% 

fmj For ewery T > r > the process 

W A (t) = J* e (t - s ^ A B dW(s), t G [t, T] 
is well defined, belongs to C([t,T]; L 2 (Q;Tt)) and has continuous trajectories in TL 



2 For (3 > the space H 13 is defined as a completion of H with respect to the norm \x\-p = (Ao — A) x\ 
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Proof, (i) It follows immediately from the definition of B and Lemma 12.21 since 



e tA Ba = a(A - A) L - a e tA (X - A) a ^ Xo , 
(ii) (ByEU) and (pj we have for a £ (|, \ + §) 



|(A -A)e sA V%| 



HS 1 



(A - A) 



(Ao-^r^o 



< 



a G 



C 

s 2(l-a) 



(21) 



and the estimate (f20l) follows immediately for a certain 7 < 2a — 1. 

(iii) Using (|20l) with 7 = we find immediately that, for every t > 0, is well defined 

and (see for example [6j Proposition 4.5 page 91) 



E \W A (t)\ 2 n = J' \e sA ((X - A)D)\ 2 HS ds < 00. 



(22) 



Such an estimate gives also, through standard arguments, the mean square continuity. The 
continuity follows from (|20l) for 7 > using a factorization argument as in [7] Theorem 2.3 
page 174. □ 

Lemma 2.4. Let T > be fixed, A > and u £ M^(t, T; R). Then the process 



I(t) = J' e {t ~ s)A Bu{s) ds, t < T, 



is well defined, I £ M^(T,T;7i), and there exists C > such that 



E||I||^<C|K 2 



Moreover, I is in C(t,T; L 2 (Q,Tt)) and has continuous trajectories. 



Proof. The first part of the Lemma follow from (|2T|) by standard arguments. The mean-square 
continuity and continuity of / follows from (fT8j) and Holder inequality (since a > 1/2) in the 
expression 



I(t) 

and the claim follows. 



(\ -Ay- a e 



l-aJt-s)A 



[(Aq — A) a Du(s)} ds. 



□ 



Definition 2.5. Let u £ Myy. An TL-valued predictable process x, defined on [0, T] is called a 
mild solution of / TT^j) if 



|x(s)| 2 ds < 00 



and 



x(t) 



e^ A x 



+ J e (t - s)A Bu(s) ds + J e^ A B dW(s) 



Theorem 2.6. Equation / TIP)) has a unique mild solution x 6 C(t,T; L 2 (Q,Tt)). Moreover, x 
has continuous trajectories P-a.s. If u = then equation U9\) defines a Markov process in TL. 

Proof. The properties of the stochastic convolution term come from Lemma 12.31 those of 
j e (t- s ) A Bu(s) from Lemma 12.41 The Markov property can be proved with standard argu- 
ments (see for example [6j Theorem 9.8 page 249). □ 
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2.4 The approximating equation 

Let Z n = f (n(n — A)' 1 ) 2 . We will approximate x using 

%n — (23) 

We have that 

x n x . (24 ) 

We use it to obtain more regularity and to guarantee the existence of a strong solution and 
then to be able to apply the Ito's rule (Proposition 13. 6p . Prom Proposition 12.61 we know 
that x n G C([T,T];L 2 (n,dom(A 2 ))). We have B n := l n B £ £(M; dom(A)) and then B n u £ 
Myy(T, T; dom( A)). Furthermore, x n satisfies the following stochastic differential equation: 

dx n (t) = (Ax n {t) + B n u{t)) dt + B n dW{t) 
x„(r)=J n x 

in strong (an then mild) sense (see [6] Section 6.1). So we have 

x n (t) = l n x + j Ax n (s) ds + J B n u(s) ds + j B n dW{s) (26) 

3 The linear quadratic problem 

Let us recall that we work under the assumption 

i i e 

2 <a< 2 + 4- 

We consider another Hilbert space Y, an operator C E CiTL; Y) and a symmetric and positive 
G £ C(TL;TL). For a fixed T > we define the set of the admissible controls as U T = 
Myy(T, T;R). We consider the linear quadratic optimal control problem governed by equation 
dl9|) and quadratic cost functional (to be minimized) 



r rT 



J(r, xq, u) := E 



(\Cx(t)& + \u(t)\l) dt+(Gx(T),x(T)) 



(27) 



The value function of the problem is 



V(t,x ) := inf J(t,x ,u) 

We consider now the "associated" deterministic linear quadratic problem. It is characterized 
by the state equation 

f x(t) = Ax(t) + Bu{t) 
\ x(t) = x , 

by the set of admissible controls Udet '■= L 2 (t,T;W) and by the functional 

Jdet(t,x ,u) := £ (\Cx(t)\l + \u{t)\l) dt + (Gx(T), x{T)) . 
In what follows we we will use the following notations. 
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Notation 3.1. E(H) = {T£ C(H;H) : T hermiUan} 

E + (H) = {Te E(H) : (Ti,3;)>0/orfl«ieH} 
C s ([0,r];E(H)) = {F: [0, T] -» E(W) : F strongly continuous] 
Note that (|3| page 137) for every P G C s ([0,F]; E(H)) 



sup ||F(t)|| < oo. (29) 
te[o,T] 



The Riccati equation formally associated with the deterministic control problem (|28l) has the 
form 

p'(t) = -A*P(t) - P(t)A* - C*C + P(t)ABB*A*P(t) 
P(T) = G, m 

but the concept of solution to this equation requires a rigorous definition. We start with some 
notations. 

Definition 3.2. We denote by C Sjlx ([0,T]; E(H)) the set of all P G C s ([0,T);E(H)) such that 
(i) F(t)x G F>((A - A*) 1 -") Vx G W,Vt G [0, T) 

(«) Vp(t) d ^ f (A - A^-Pit) G C([0,T);£(W)) 
(Hi) lim t _ T - ((T - t) l ' a V P {t)x) =0 Vx G W 

Given P G C S!Q ,([0, T]; E(W)), £/ie norm |F| a is defined as 

\P\ a = sup ||F(t)||+ sup (T-tf-^WiXo-A^Pit)]] 
te[o,T) te[o,r) 

It can be proved (see [3j page 205) that C SjQ ([0, T]; E(W)), endowed with the norm | • | Q , 

is a Banach space. We will use the notation E = f (Ao — A) a D G C(M.;7i). 
Note that if |F| Q < oo then (since a > 1/2) 

\ p \l 2 (o,T;C(H)) < 00 ( 31 ) 

Definition 3.3. We say that P G C S)Qi ([0, T]; E(7i)) is a wea& solution of the Riccati equation 
if for all x, y G dom(^) and a// i G (0, T) 

f t (P(t)x, y) = - (P(t)x, Ay) - (P(t)Ax, y) - (Cx, Cy) + (E*V P (t)x, E*V P (t)y) 
F(T) = G. (6 ' 

We recall now the existence and uniqueness theorem for the ([321 : 

Theorem 3.4. (i) The Riccati equation VSty has a unique weak solution in P in 
C s>a ([0,T];E+(H)) 

(ii) P G C SiQ ([0, T]; Y, + (Ti)) is a weak solution of IIS(J\) if and only if it solves the following 
mild equation: 

P(t) = e ^ A *Ge^ A + j\^ A *C*Ce^ A ds 

+ J* e^ A *V^{s)EE*V P (s)e ( - s -^ A ds (33) 

Proof. See [3] Theorem 2.1 page 207 for the proof of (i) and [3] Proposition 2.1 page 206 for 
(ii). ' " " " □ 
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3.1 Dynamic Programming 
Lemma 3.5. We have that 

[ T <((A - A)if; Xo ), P(t)((A - A)^ Xo )) n dt < oo 
Jo 

Proof. We use the fact that P satisfies the mild equation (|33l) . We have that 

[ T (((A - A)V%),P(t)((A - ^)V-A )) W dt 
Jo 

= / J E*(A -^) 1 - Q P(t)(A -^) 1 " Q J E(l)dt 
■/ o 



Ji + 1 2 + h 



def 



/ £*(A - ^) 1 ~ a e( T - t ) A *Ge( T - t ) A (A - A) 1 - Q E(1) dt 
Jo 

+ jT P*(A - A*) 1 '* (J e^ A *C*Ce^ A ds^) (A - A)^ a E(l) dt 

+ f E*{\ - A*) l ~ a f T e {s - t)A *Vl,{s)EE*Vp{s)e {s - t)A ds{\ - A) l ~ a E{l)dt. (34) 

For I\ we have only to check the integrability for t — > T and it follows from the fact that 
a > 1/2 and from (QSJ): ||((A - A*) 1_a e( r -*) A *) || < Mi_ a (T - i) 1 "". For I 2 we proceed in 
a similar way: we can write I2 as: 

i-T pT 



h 



Jt 



C ((A - A) 1 -"e (s ~ t)A ) E(l) 



dsdt 



and we can conclude as for I\, using (fT8|) . For ^3 we can observe that: 

rT f T 2 



I 3 = f [ E*(X - A*) 1 - Q e (s -' )A V^(s) J E(l) 



ds dt 



Note that from (u) of Definition 13,21 and from the fmiteness of the norm \P\ a we know that 

Ci 



|V?(«)|| < 



(T- S ) 



1-0 



(35) 



and 



|S*(Ao-^*) 1_a e( s -*) A *|| < ( 2 



(s-ty- 



The claim follows by straightforward computations. 



□ 



Proposition 3.6. If u £ My^(r, T;R) is a control and x is the related trajectory, then 



E 



(Gx(T), x(T)) + £ \Cx(t)\ 2 Y + |«(t)|| dt 
= (P{t)x(t),x{t)} +E 



\u(t) + E*V P (t)x(t)\\ 



T 



+ 1 -((\ -A)^ Xo ,P(t)((X -A)^ Xo )) H dt. (36) 
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Proof. We will perform the following steps: we first approximate x using x n denned in (|23j) 
then we compute -4^ (P(t)x n (t),x n (t)) dt using Ito's formula and eventually we will con- 
sider to the limit n — > oo and then To — > T. Let C{dom.(A); TL) be the space of bounded opera- 
tors from dom(.A) endowed with the graph norm to TL. Note that since P G C([r, T); £(W; 7i)) 
it is a fortiori and element of C([r, T); £(dom(A); H)). Consider To < T and the following 
function (dom(^4) is endowed with the graph norm) 

$ : [r, T ] x dom(A) -» R 
i ^ (P(t)x,x) H . 

Note that in the definition of $ we use the scalar product of TL and not of dom(^4). <E> is twice 
continuously differentiable with locally bounded derivatives in x on [r, To] xdom(^4). Moreover 
we have that d x <fr(t,x) = P(t)x and d^(t,x)(y, z) = 2 (P(t)y, z) n . The first derivative in t 
is also continuous and locally bounded on [r, To] x dom(A). Invoking (|32|) we have 

f t (P(t)x, y) H = - (P(t)x, Ay) H - (P(t)Ax, y) - (Cx, Cy) n + 
+ (E*Vp(t)x,E*V P (t)y) n . 

Such an expression can be discontinuous for t = T only (this is the reason why we have 
considered a To < T). We have already observed that x n satisfy the integral equation (|26|) 
also in dom(A) and then we can use the Ito's rule (see [6] page 105): we have that 



(P(T )x n (T ),x n (T )) = {P(r)x n (T),x n (T)) 



To 



(CXn(t),Cx n (t))y dt 



T 



T 



+ 



(P{t)x n (t),Ax n (t)) dt + J (E*V P (t)x n (t), E*V P {t)x n (t)) R dt 

/To pTo 
(V P (t)x n (t),ln{Xo ~ A) a Du{t)) dt + 2 J (P(t)xn(*), Ax n {t)) dt 



T 



{V P (t)x n (t),ln(\o - A) a DdW(t)) dt 



+ 



To 



- (((A - A)I n t/; Xo ), P(i)((A - A)l n ^ Xo )) H dt. (37) 



By simplifying the terms (P(t)x n (t), Ax n {t)) , adding and subtracting |u(t)|^ and 
2 Jq° (u(t) , E*Vp(t)x n (t)) R inside the integral and taking the expectation we find: 



E 



(T(T )x n (T ),x ri (To)> + 



To 



\Cx n (t)\l + \u(t)\ldt 
rT 



(P(T)x n (r),x n (r))+E 

"To 



\u(t) + E*V P (t)x n (t)\i 



+ 2E 



(V P (t)x n (t), (l n - J)(A - A) a Du(t)} dt 



+ 



T, 



- (((A - A)I n t/; Xo ), P(i)((A - A)T^a )) w dt. (3? 
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We want now to pass with n — > oo. Since by ([2^1 we have x n — ' — ^ W\ x ^ ^ j g c i ear 

n^oo 

that 

Jim E (V (T ) x n (T ) , x n (T )) + |Cx n (*)£ dt) = E ((P (T ) x (T ) , x (T )> + £° \Cx(t)\ 2 Y dt 



and 



lim (P(r)x n (r),x n (r)) = <P(r)s(r),a;(r)) 



Since Vp £ C([t,Tq} ;C(TL)) and (Ao — A) a D = E is bounded, the Dominated convergence 
yields 



lim E f| ° |«(t) + £^Vp(t)a; n (t)|| dt + 2 fj (Vp(t)x n (t), (Z„ - /) (A - A) Q D«(t)) dt' 

= Ey ° |«(t) + P*Vp(t)x(t)|jjj,dt. 
Finally, using the arguments similar to those in the proof of Lemma 13.51 we obtain 

hm E J ° ~ ((A - A)T„Va , Pit) (Ao - A) J n ^Ao) w dt = E ^ ° ^ ((A - A) V% , P(t) (A - A) * 
and therefore, putting together the above results we obtain 



E 



To 

(P(7 u ).r(7 (1 )..r(7 n )'; - / \Cx{t) \ 2 y + \u(t) || dt 

To 



(P(t)x(t),x(t))+E 



T 



\u(t) + E*V P (t)x(t)\i 



\ (((Ao - A)i; Xo ), P(t)((X - A)^ Xo )) H dt. (39) 



Now we pass to the limit in To | T in ([39]) . To show the convergence of the left hand side of 
([39]) it is enough to invoke monotone convergence and to show that 



lim E (P (T ) x (T ) , x (T )> =E(P (T) x (T) , x (T)> . 

To— *T 



(40) 



To this end note that 



(P(T)x(T),x(T)) - (P (T )x(T ),x(T )) 

= ((P(T)-P(T ))x(T),x(T)) 
+ (P(T )(x(T) - x(T )),x(T)) + (P(T )x(T Q ),x(T) - x(T )) . (41) 

Then the strong continuity of P at T yields 

lim <(P(T) - P (T )) x(T), z(T)> = 

hence by (ESJ) and the fact that a; € C([t,T]; L 2 (£l;H.)) and the Dominated Convergence we 
obtain 

hm E ((P(T) - P (T )) x(T), x(T)) = 0. 

To— >T 
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Again, since x £ C([t,T]; L 2 (Q;Ti)), we find that 



/ \ 1/2 

|E (P(T )(x(T) - x(T )),x(T)) | < sup ||P(i)|| supE|x(t)| 2 (l \x(T) - x (T 



1/2 



and therefore 



lim E{P(T o )(x(T)-x(T Q )),x(T))=0. 



By the same arguments we obtain 



hm E(P(T )x(T ),x(T) - x(T )) = 
Jo— *1 



and therefore we obtain the convergence of the left hand side of (1391) . To prove convergence 
of the second term in the right side of ([39]) it is enough to show that Vpx G M|^(t, T;7i). 
Indeed, invoking (|35l) we have 



T 



1/ |Vp(s)x(s)| 2 ds < C 3 / ||Vp(s)|| 2 K|a;(s)| 2 ds 



< C 4 \x\ C{[T>T] . L 2 in . H)) \\V P (s)\\ ds<oo. 



(42) 



The convergence for the third term of the right side of (|39j) for To — > T follows from Lemma 

□ 



Theorem 3.7. Ze£ r G [0, T] and xq be inTL. Then there exists a unique optimal pair (u* , x* 
at (t,xq). The optimal control u* is given by the feedback formula 



u*(t) = -E*V P (t)x*(t) 
and the value function of the problem is 

~ 1 



(43) 



V(t,x ) = (P(t)x ,x } + J -(((X -A)i; Xo ),P(s)((X -A)i; Xo )} n ds 
Proof. We begin proving that the equation 

x *(t) = e ( *- T)A x - J\\ ~ A) l - a e {t - s)A EE*V P {s)x*{s) ds + J* e^ A BdW(s) (44) 
has a unique solution and it is in C([r, T]; L 2 (Q; TL)). Consider the mapping 

<P i — ^ *&{<f>) 

= e (*--M Xo - ! A) l - a e {t - s)A EE*V P {s)<P{s)ds 
t 

+ J e^- s ^ A BdW(s). 
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We want to prove that \&(</>) defines a contraction on C([t, £]; L 2 (f2; H)) if we choose t small 
enough. Consider ip and in C([t,T]; L 2 (Q;Tt)): 



E[|(*(V) -*(</>))(*)!' 



E 



< CiE 



(A - A) 1 ""^'-^) EE?V P {8)(il) - <j))(s) dt 



\Vp\] 



\^-^)(s)\ 2 ds 



L*{0,T;C{K)) J r {f _ s) 2(l-a) 



<C 2 |(V-</>)(s)| C (M;i 2 (^)) J t (t _ s)2 (l-a) 



■ ds (45) 



where the constants C\ and C2 do not depend on t. So if t is small enough ^ is a contraction 
on C([r,t};L 2 (n;H)). Similar estimates (together with the fact that W A G C(t,T; L 2 (n-,H)) 
prove that the image of ^ is in C([r, i]; L 2 (f2; H)). Proceeding by iterations (we can choose 
an uniform step) we have the existence and uniqueness of the solution of the ([441) on 
C([T,T];L 2 (n;H)). 

We will prove now that u* defined by (l43j) is the optimal control. Its admissibility (that 
is u* G M^(t, T;R)) can be proved using the same argument we used in (14*2|) . 
Now we observe that Proposition 13.61 implies, for every u G M^(r,T;R), 



J(r,a;o,u) > (P(r)aj 0) so) + 
and the couple (u*,x*) satisfies 



1 



<((A„- A)^ Xo ),P(t)((X -A)^)) H dt 



(46) 



J(t,x ,u*) = (P(t)x ,x ) + j -(((\ -A)i> Xo ),P(t)({\ -A)ij Xo )) n dt (47) 
so it is optimal. If (it, x) is another optimal couple then by (l46j) and (|47l) we have 



J(r, xo,m) = (P(r)x ,x ) + 
and then (f39l) yields 



(((A -A)^o),^)((Ao -^A )) w dt 



a.e. 



|ti(t)+S*Vp(t)x(t)| =0 eft® 

and then rr satisfies (f44]> but the solution to (|44l) is unique by Theorem 12.61 solution and finally 
we can choose continuous versions of x and u such that x* = x and u* = u. □ 
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